Intel 10GBASE-T in TACC Dynamic Hadoop Environment
ثبت نشده
چکیده
Due to advances in 10GBASE-T technology, faster interconnects are now more affordable. This gives organizations the opportunity of deploying a cost-effective, high performance Hadoop cluster based on 10 GbE interconnects. As part of this paper, we have partnered with the Texas Advanced Computing Center (TACC) to examine how their unique implementation of Hadoop can benefi t from Intel’s cutting-edge 10GBASE-T CNA: the Intel Ethernet Converged Networking Adapter X540.
منابع مشابه
Adaptive Dynamic Data Placement Algorithm for Hadoop in Heterogeneous Environments
Hadoop MapReduce framework is an important distributed processing model for large-scale data intensive applications. The current Hadoop and the existing Hadoop distributed file system’s rack-aware data placement strategy in MapReduce in the homogeneous Hadoop cluster assume that each node in a cluster has the same computing capacity and a same workload is assigned to each node. Default Hadoop d...
متن کاملOptimizing Hadoop* Deployments
Intel is a major contributor to open source initiatives, such as Linux*, Apache*, and Xen*, and has also devoted resources to Hadoop analysis, testing, and performance characterizations, both internally and with fellow travelers such as HP and Cloudera. Through these technical efforts, Intel has observed many practical trade-offs in hardware, software, and system settings that have real-world i...
متن کاملAdaptive Channel-shortened Interpolated Echo and next Canceller Designs Applied to 10gbase-t Ethernet System*
In this paper, new echo and NEXT cancellers are proposed for echo and NEXT cancellation in full-duplex digital transmission over 10GBASE-T system. The proposed cancellation schemes inherit the concept of the adaptive interpolated FIR (AIFIR)-based crosstalk canceller, where the long portion is modeled by an adaptive sparse FIR filter. Furthermore, we also employ the channel shortening technique...
متن کاملPerformance Analysis of an Astrophysical Simulation Code on the Intel Xeon Phi Architecture
We have developed the astrophysical simulation code XFLAT to study neutrino oscillations in supernovae. XFLAT is designed to utilize multiple levels of parallelism through MPI, OpenMP, and SIMD instructions (vectorization). It can run on both CPU and Xeon Phi co-processors based on the Intel Many Integrated Core Architecture (MIC). We analyze the performance of XFLAT on configurations with CPU ...
متن کاملBuilding a Robust 10GBASE-T Solution White Paper
Ethernet on Twisted-pair Cabling Since the early days of 10BASE-T Ethernet, twisted pair cabling has been the most ubiquitous media type for wired LAN communications and is found in every data center universally. The industry has enjoyed the advantages of this low cost, simple-to-use cabling for three generations, and is now deploying 10GBASE-T at one thousand times (1000x) the data rate of 10B...
متن کامل